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Time domain watemiarking of multimedia signals 



The present invention relates to apparatus and methods for encoding and 
decoding information in multimedia signals, such as audio, video or data signals. 

Watermarking of multimedia signals is a technique for the transmission of 
5 additional data along with the multimedia signal. For instance, watermarking techniques can 
be used to embed copyright and copy control iaformation into audio signals. 

The main requirement of a watermarking scheme is that it is not observable 
(i.e. in the case of an audio signal, it is inaudible) whilst being robust to attacks to remove the 
watermark from the signal (e.g. removing the watermark will damage the signal). It will be 

10 appreciated that the robustness of a watermark will normally be a trade off against the quality 
of the signal in which the watermark is embedded. For instance, if a watermark is strongly 
embedded into an audio signal (and is thus difficult to remove) then it is likely that the 
quality of the audio signal will be reduced. 

Various types of audio watermarking schemes have been proposed, each with 

15 its own advantages and disadvantages. For instance, one type of audio watermarking scheme 
is to use temporal correlation techniques to embed the desired data (e.g. copyright 
information) into the audio signal. This technique is effectively an echo-hiding algorithm, in 
which the strength of the echo is determined by solving a quadratic equation. The quadratic 
equation is generated by auto-correlation values at two positions: one at delay equal to x, and 

20 one at delay equal to 0. In such a scheme, as echoes of the audio signal are added to the 

original audio signal, the resulting signal is in fact both an amplitude and a phase modulated 
version of the original audio signal. At the detector, the watermark is extracted by 
determining the ratio of the auto correlation function at the two delay positions. 

This correlation technique has a number of drawbacks. For instance, it is only 

25 possible to embed the watermark where the resulting quadratic equation has real roots, and 
consequently this reduces the robustness (ability of the watermark to withstand attacks) for a 
given audio quality. Further, the performance of the correlation algorithm is dependent upon 
the value of the delay x and the characteristics of the original signal. This is a significant 
drawback. 
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Also known are watermarking schemes based on the amplitude modulation of DFT (Discrete 
Fourier Transform) coefficients. As such schemes require the calculation of DFTs at both the 
encoder and the decoder, the resulting hardware for implementing such DFT schemes tends 
to be relatively complex, and hence the scheme tends to be slow to perform and costly. 
5 Further, watermarks cannot be satisfactorily embedded in audio segments that have sparse 
frequency characteristics, and hence the DFT scheme does not work well with particular 
types of music. 

WO 00/00969 describes an altemative technique for embedding or encoding 

10 auxiliary signals (such as copyright information) into a multimedia host or cover signal. A 
replica of the cover signal, or a portion of the cover signal in a particular domain (time, 
frequency or space), is generated according to a stego key, which specifies modification 
values to the parameters of the cover signal. The replica signal is then modified by an 
auxiliary signal corresponding to the information to be embedded, and inserted back into the 

15 cover signal so as to form the stego signal. 

At the decoder, in order to extract the original auxiliary data, a replica of the 
stego signal is generated in the same manner as the replica of the original cover signal, and 
requires the use of the same stego key. The resulting replica is then correlated with the 
received stego signal, so as to extract the auxiliary signal. The extraction of the auxiliary 

20 signal is thus relatively complex, and requires the stego key at both the encoder (or 
embedder) and decoder (or detector). Additionally, a brute force search is required to 
synchronize to the auxiliary signal at the detector. 

Further, performance of the payload extraction is dependent on how well the 
auxiliary signal can be estimated. In a system with a high expected error rate of the payload 

25 bits in the auxiliary signal, this is very difficult to achieve. Solutions would lead to very 
complex error correction methods, or significantly limit the information capacity. 

It is an object of the present invention to provide a watermarking scheme that 
substantially addresses at least one of the problems of the prior art. 

30 In a first aspect, the present invention provides a method of generating a 

watermark signal for embedding in a multimedia signal, the method comprising the steps of: 
(a) generating two sequences of values, the second sequence being a circularly shifted 
version of the first sequence; and (b) generating a watermark signal by adding the values of 
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the first sequence to the respective values in the corresponding positions of the second 
sequence. 

Preferably, each value of the first and second sequences is represented by a 
pulse of preferable width Ts so as to form rectangular wave signals. 
5 Preferably, in step (a) a window shaping function is applied to convert each of 

the rectangular signals into respective smoothly varying signals, with the resulting smoothly 
varying signals being added in step (b) to form the watermark signal. 

Preferably, each one of said sequences of values is convolved with a window 
shaping function which has a width of at least Ts, so as to generate two smoothly varying 
10 signals, these smoothly varying signals being added together in step (b) so as to form the 
watermark signal. 

Preferably, said window shaping function has a band limited frequency 
behavior and a smooth temporal behavior. 

Preferably, said window shaping function has a symmetric or anti-symmetric 
1 5 temporal behavior. 

Preferably, said window shaping function comprises at least one of a raised 
cosine function and a bi-phase function. 

Preferably, the watermark signal is generated by the addition of the two 
smoothly varying signals with a relative delay of Tr, where Tr < Ts. 
20 Preferably, Tr is chosen such that maximum amplitude points of the first 

smoothly varying signal coincide with zero-crossings of the second smoothly varying signal, 
and vice-versa. 

Preferably, said watermark signal has a payload that is encoded in the 
combination of said two sequences of values. 

25 In another aspect, the present invention provides an apparatus arranged to 

generate a watermark signal for embedding in a multimedia signal, the apparatus comprising: 
(a) a sequence generator arranged to use a first sequence of values to generate a second 
sequence of values, the second sequence being a circularly shifted version of the first 
sequence; and (b) a signal generator arranged to generate a watermark signal by adding the 

30 values of the first sequence to the respective values in the corresponding positions of the 
second sequence. 

Preferably, the apparatus further comprises a signal conditioner arranged to 
convert each sequence of values into a smoothly varying signal. 
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Preferably, the apparatus is arranged to generate said first sequence of values 

by circularly shifting a primary sequence of values. 

In a further aspect, the present invention provides a method of embedding a 

watermark in a multimedia signal, the method comprising the steps of: (a) generating a 
5 watermark signal equal to the sum of two sequences of values, the second sequence being a 

circularly shifted version of the first sequence of values; (b) generating a host modifying 

multimedia signal as a product of the watermark signal and the multimedia signal; (c) 

generating a watermarked multimedia signal by adding a scaled version of said host 

modifying multimedia signal to the multimedia signal. 
10 Preferably, said scaled version of the host modifying signal is generated by 

controlling the scaling factor by a predetermined cost-function. 

Preferably, said cost function comprises multiple scaling factors, each scaling 

factor being defined separately for one or more of the plurality of frequency bands in the 

multimedia signal. 

15 Preferably, said frequency bands are determined according to a model of the 

human auditory and/or visual system. 

Preferably, in step (b) said host modifying multimedia signal is generated by 
multiplying said watermark signal with an extracted portion of the multimedia signal. 

Preferably, said extracted portion of the multimedia signal is obtained by 
20 filtering at least a portion of the multimedia signal with respect to at least one of frequency, 
space and time. 

The method preferably further comprises the steps of: (d) generating a second 
watermark signal equal to the sum of a third and a fourth sequences of values, the fourth 
sequence being a circularly shifted version of the third sequence of values; (e) extracting a 

25 second portion of the multimedia signal, the second portion being filtered such that it does 

not overlap with said first portion; (f) generating a watermarked multimedia signal by adding 
the product of the second watermark signal and the second extracted portion of the 
multimedia signal to the watermarked multimedia signal. 

In another aspect the present invention provides an apparatus arranged to 

30 embed a watermark signal in a multimedia signal, the apparatus comprising; (a) a watermark 
generator arranged to generate a signal equal to the sum of two sequences of values, the 
second sequence being a circularly shifted version of the first sequence of values; (b) an 
output signal generator arranged to generate a watermarked multimedia signal by adding the 
product of the watermark signal and the multimedia signal to the multimedia signal. 



PHNL020240 



5 26.03.2002 
Preferably, the apparatus further comprises a signal extractor arranged to 
extract a first portion of the multimedia signal. 

In a further aspect the present invention provides a multimedia signal 
comprising a watermark, wherein the original multimedia signal has been watermarked by 
modifying the temporal envelope of the original signal by the watermark, the watermark 
comprising the sum of a first and a second sequences of values, the second sequence of 
which is a circularly shifted version of the first sequence. 

In another aspect the present invention provides a method of detecting a 
watermark signal embedded in a multimedia signal, the method comprising the steps of: (a) 
receiving a multimedia signal that may potentially be watermarked by a watermark signal 
modifying the temporal envelope of the host multimedia signal; (b) extracting an estimate of 
the watermark from said received signal; and (c) correlating the estimate of the watermark 
with a reference version of the watermark so as to determine whether the received signal was 
watermarked. 

Preferably, the watermark signal has a payload, and the method further 
comprises the step of determining the payload of the watermark. 

In a further aspect, the present invention provides a watermark detector 
apparatus arranged to detect whether a watermark signal is embedded within a multimedia 
signal, the watermark detector comprising: (a) a receiver arranged to receive a multimedia 
signal that may potentially be watermarked by a watermark signal modifying the temporal 
envelope of the host multimedia signal; (b) an extractor arranged to extract an estimate of the 
watermark from said received signal; and (c) a correlator arranged to correlate the estimate of 
the watermark with a reference version of the watermark so as to determine whether the 
received signal was watermarked. 

Preferably, the apparatus further comprises a payload detector arranged to 
determine if a payload is present within said watermark and to determine the value of said 
payload. 

For a better understanding of the invention, and to show how embodiments of 

the same may be carried into effect, reference will now be made, by way of example, to the 
accompanying diagrammatic drawings in which: 

Figure 1 is a diagram illustrating a watermark embedding apparatus in 
accordance with an embodiment of the present invention; 
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Figure 2 shows a signal portion extraction filter H used in one preferred 

embodiment; 

Figures 3 a and 3b show respectively the typical amplitude and phase responses 
as a function of frequency of the filter H used in Fig. 2; 
5 Figure 4 shows the payload embedding and watermark conditioning stage; 

Figure 5 is a diagram illustrating the details of the watermark conditioning 
apparatus He of Fig. 4, including charts of the associated signals at each stage; 

Figure 6a and 6b show two preferred altemative window shaping fimctions 
s(n) in the form of respectively a raised cosine function and a bi-phase function; 
10 Figures 7a and 7b show respectively the frequency spectra for a watermark 

sequence conditioned with a raised cosine and a bi-phase shaping window function; 

Figure 8 is a diagram illustrating a watermark detector in accordance with an 
embodiment of the present invention; 

Figure 9 diagrammatically shows the whitening filter Hw of Fig. 8, for use in 
15 conjunction with a raised cosine shaping window function; 

Figure 10 diagrammatically shows the whitening filter Hwof Fig. 8, for use in 
conjunction with a bi-phase window shaping function; and 

Figure 1 1 shows a typical shape of the correlation function output from the 
correlator of the watermark detector shown in Fig. 8. 

20 

Fig. 1 shows a block diagram of the apparatus required to perform the digital 
signal processing for embedding a multi-bit payload watermark Wc into a host signal x in 
accordance with a preferred embodiment to the present invention. 

A host signal x is provided at an input 12 of the apparatus. The host signal x is 
25 passed in the direction of output 14 via the adder 22. However, a replica of the host signal x 
(input 8) is split off in the direction of the multiplier 18, for carrying the watermark 
information. 

The watermark signal Wc is obtained from the payload embedder and 
watermark conditioning apparatus 6^ and derived from the watermark random sequence Ws 
30 (input 4), which is input to the payload embedder and watermark conditioning apparatus. The 
multiplier 1 8 is utilized to calculate the product of the watermark signal Wc and the replica 
audio signal x. The resulting product, WcX is then passed via a gain controller 24 to the adder 
22. The gain controller 24 is used to amplify or attenuate the signal by a gain factor a. 
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The gain factor a controls the trade off between the audibility and the 
robustness of the watermark. It may be a constant, or variable in at least one of time, 
frequency and space. The apparatus in Fig. 1 shows that, when a is variable, it can be 
automatically adapted via a signal analyzing unit 26 based upon the properties of the host 
5 signal x. Preferably, the gain a is automatically adapted, so as to minimize the impact on the 
signal quality, according to a properly chosen perceptibility cost- function, such as a psycho- 
acoustic model of the human auditory system (HAS ). Such a model is, for instance, described 
in the paper by E.Zwicker, "Audio Engineering and Psychoacoustics: Matching signals to the 
final receiver, the Human Auditory System", Joumal of the Audio Engineering Society, Vol. 
10 39, pp. Vol.1 15-126, March 1991. 

In the following, an audio watermark is utilized, by way of example only, to 
describe this embodiment of the present invention. 

The resulting watermark audio signal y is then obtained at the output 14 of the 
embedding apparatus 10 by adding an appropriately scaled version of the product of Wc and x 
15 to the host signal: 

y\ri\ = x\ri\ + aWc \ri\x\ri\ . (1) 



Preferably, the watermark Wc is chosen such that when multiplied with x, it 
predominantly modifies the short time envelope of x. 

Fig. 2 shows one preferred embodiment in which the input 8 to the multiplier 
20 1 8 in Fig. 1 is obtained by filtering the replica of the host signal x using a filter H in the 
filtering unit 15. If the filter output is denoted by x^, then according to this preferred 
embodiment, the watermarked signal is generated by adding an appropriately scaled version 
of the product of xt and the watermark Wc to the host signal x. 

Let xjy be defined such that = x - x^ , and be defined such that 

25 y = yb~^^br> then the watermarked signal y can be written as 

y{n\ = (1 + w,[w])x^,[n] + x^,[n] . (2) 

and the envelope modulated portion of the watermarked signal j is given as 

J6 [^] = (1 + [n])Xb [n] (3) 



30 



Preferably, as shown in Fig. 3, the filter His a linear phase band-pass filter 
characterized by its lower cut off frequency fi and upper cut off frequency fn. As can be seen 
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in Fig. 3b, the filter H has a linear phase response with respect to frequency / within the pass 
band (BW). Thus, when is a band-pass filter, Xb and are the in-band and out-of-band 
components of the host signal respectively. For optimum performance, it is preferable that 
the signals Xb and Xb are in phase. This is achieved by appropriately compensating for the 
5 phase distortion produced by filter H. 

In Fig. 4, the details of the payload embedder and watermark conditioning unit 
6 is shown. In this unit the watermark seed signal Ws is converted into a multi-bit watermark 
signal Wc. 

Firstly a finite length, preferably zero mean and uniformly distributed random 
10 sequence Ws is generated using a random number generator with an initial seed S. As will be 
appreciated later, it is preferable that this initial seed S is known to both the embedder and the 
detector, such that a copy of the watermark signal can be generated at the detector for 
comparison purposes. This results in the sequence of length 

G [-1,1], for k=0J^2 U-l (4) 

Then the sequence Ws is circularly shifted by the amounts di and d2 using the 

15 circularly shifting units 30 to obtain the random sequences Wdi and Wdi respectively. It will be 
appreciated that these two sequences {wdi and Wdi) are effectively a first sequence and a 
second sequence, with the second sequence being circularly shifted with respect to the first. 
Each sequence Wdu i ^ I52, is subsequently multiplied with a respective sign bit in the 
multiplying unit 40, where ri = +1 or -1, the respective values of ri and V2 remaining constant, 

20 and only changing when the payload of the watermark is changed. Each sequence is then 
converted into a periodic, slowly varying narrow-band signal W/ of length L^Ts by the 
watermark conditioning circuit 20 shown in Fig. 4. Finally, the slowly varying narrow-band 
signals wy and W2 are added with a relative delay 7> (where Tr<Ts) to give the multi-bit 
payload watermark signal Wc. This is achieved by first delaying the signal W2 by the amount 

25 Tr using delaying unit 45 and subsequently by adding it to with the adding unit 50. 

Fig. 5 shows in more detail the watermark conditioning apparatus 20 used in 
the payload embedder and watermark conditioning apparatus 6. The watermark random 
sequence Ws is input to the conditioning apparatus 20. 

For convenience, the modification of only one of the sequences w^/ is shown 

30 in Fig. 5, but it will be appreciated that each of the sequences is modified in a similar manner, 
with the results being added to obtain the watermark signal Wc. 
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As shown in Fig. 5, each watermark signal sequence Wdi[k], i=l,2 is apphed to 
the input of a sample repeater 180. Chart 181 illustrates one of the possible sequences Wdi as a 
sequence of values of random numbers between +1 and -1, with the sequence being of length 
Lw. The sample repeater repeats each value within the watermark random sequence Ts times, 
so as to generate a pulse train signal of rectangular shape. Ts is referred to as the watermark 
symbol period and represents the span of the watermark symbol in the audio signal. Chart 
183 shows the results of the signal illustrated in chart 181 once it has passed through the 
sample repeater 180. 

A window shaping function sfnj, such as a raised cosine window, is then 
applied to convert the rectangular pulse signals derived from Wdi and Wd2 into slowly varying 
signals wjfnj and W2[n] respectively. 

Chart 184 shows a typical raised cosine window shaping function, which is 
also of period Ts. 

The generated signals wi[n] and W2[n] are then added up with a relative delay 
Tr (where Tr<Ts) to give the multi-bit payload watermark signal Wc[n] i.e. 

[n\ = w^\_n\ + W2[n-T,^ (5) 



The value of 7> is chosen such that the zero crossings of >v/ match the 
maximum amplitude points of W2 and vice-versa. Thus, for a raised cosine window shaping 
function Tr=Ts/2, and for a bi-phase window shaping function Tr=Ts/4, For other window 
shaping functions, other values of TV are possible. 

As will be appreciated by the below description, during detection the 
watermarked signal carrying Wc[n] will generate two correlation peaks that are separated by 
pL (as can be seen in Fig. 11). The value pL is part of the payload, and is defined as 



pL =\ ^2 - ^1 1 mod 



(6) 



In addition to pL, extra information can be encoded by changing the relative 
signs of the embedded watermarks. 

In the detector, this is seen as a relative sign rsign between the correlation 
peaks. It will be seen that rsign can take four possible values, and may be defined as: 
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where pi=s,ig[v(cLi) and p2=si^(cL2) are respectively estimates of the sign bits (input 80) 
and r2 (input 90) of Fig. 4, and cLi and cZ,^ are the values of the correlation peak 
corresponding to Wdi and Wdi respectively. The overall watermark payload pL^ is then given 
5 as a combination of /"sign and pL: 

pLy, = {r^ig^, pL) . (8) 



The maximum information (Imax), in number of bits, that can be carried by a 
watermark sequence of length is thus given by: 



log2 4- 



bits 



(9) 



10 In such a scheme, the payload is immune to relative offset between the 

embedder and the detector, and also to possible time scale modifications. The window 
shaping function has been identified as one of the main parameters that controls the 
robustness and audibility behavior of the present watermarking scheme. As illustrated in 
Figs. 6 a and b, two examples of possible window shaping functions are herein described - a 

15 raised cosine function and a bi-phase function. 

It is preferable to use a bi-phase window function instead of a raised cosine 
window function, so as to obtain a quasi DC-free watermark signal. This is illustrated in 
Figs. 7 a and 7 b, which show the frequency spectra corresponding to a watermark sequence 
(in this case a sequence of WcufkJ = {1,1,-1,1,-1,-1,}) conditioned with respectively a raised 

20 cosine and a bi-phase window shaping function. As can be seen, the frequency spectrum for 
the raised cosine conditioned watermark sequence has a maximum at frequency /= 0, whilst 
the frequency spectrum for the bi-phase shaped watermark sequence has a minimum at/= 0 
i.e. it has very little DC component. 

Useful information is only contained in the non-DC component of the 

25 watermark. Consequently, for the same added watermark energy, a watermark conditioned 
with the bi-phase window will carry more useful information than one conditioned by the 
raised cosine window. As a result, the bi-phase window offers superior audibility quality for 
the same robustness or, conversely, it allows a better robustness for the same audibility 
quality. 
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Such a bi-phase function could also be utilized as a window shaping function 
for other watermarking schemes. In other words, a bi-phase function could be applied to 
reduce the DC component of signals (such as a watermark) that are to be incorporated into 
another signal. 

5 Fig. 8 shows a block diagram of a watermark detector (200, 300, 400). The 

detector consists of three major stages: (a) the watermark symbol extraction stage (200), (b) 
the buffering and interpolation stage (300), and (c) the correlation and decision stage (400). 

In the symbol extraction stage (200), the received watermarked signal y'[n] is 
processed to generate multiple (A^^) estimates of the watermarked sequence, which are 

10 multiplexed into the signal We[m]. These estimates of the watermark sequence are required to 
resolve any time offset that may exist between the embedder and the detector, so that the 
watermark detector can sjmchronize to the watermark sequence inserted in the host signal. 

In the buffering and interpolation stage (300), these estimates are de- 
multiplexed into Nb separate buffers. An interpolation is subsequently applied to each buffer 

15 to resolve possible timescale modifications that may have occurred. For instance, a drift in 
sampling (clock) frequency may result in a stretch or shrink in the time domain signal (i.e. 
the watermark may have been stretched or shrunk). 

In the correlation and decision stage (400), the content of each buffer is 
correlated with the reference watermark and the maximum correlation peaks are compared 

20 against a threshold to determine the likelihood of whether the watermark is indeed embedded 
within the received signal y '[n]. 

In order to maximize the accuracy of the watermark detection, the watermark 
detection process is typically carried out over a length of received signal j; '/>2/ that is 3 to 4 
times that of the watermark sequence length. Thus each watermark symbol to be detected can 

25 be constructed by taking the averages of several symbols. This averaging process is referred 
to as smoothing, and the number of times the averaging is done is referred to as the 
smoothing factor Sf. Thus, the detection window length Ld is the length of the audio segment 
(in number of samples) over which a watermark detection truth-value is reported. 
Consequently, Ld=sjL^,J's, where Ts is the symbol period and the number of symbols 

30 within the watermark sequence. Typically, the length (Lb) of each buffer 320 within the 
buffering and interpolation stage is Lb=SfLw. 

In the watermark symbol extraction stage 200 shown in Fig. 8, the incoming 
watermark signal y'fnj is input to the signal conditioning filter Hb(2 10). This filter 210 is 
typically a band pass filter and has the same behavior as the corresponding filter H (15) 
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shown in Fig. 2. The output of the fiUer Hb is y 'b[n], and assuming linearity within the 
transmission channel, it follows from equations (2) and (3): 
y\ \n\ « yb\n\ = (1 + aw^ [«] 



(10) 



Note that when no fiher is used in the embedder (i.e., when H=l) then Hb in 



5 the detector can also be omitted, or it can still be included to improve the detection 

performance. If Hb is omitted, then yb in equation (10) is replaced with y. The rest of the 
processing is the same. 



embedder and the detector (i.e. no offset and no change in timescale), and that the audio 
10 signal is divided into frames of length Ts^ and that y 'b,m[n] is the n-th sample of the m-th 

frame of the filtered signal y \[n]. It should be noted that if there is not perfect synchronism 
between the embedder and the detector, then any deviation can be compensated for within the 
buffering and interpolation stage 300 utilizing techniques known to the skilled person e.g. 
iteratively searching through all possible scale and offset modifications until a best match is 
15 achieved. 



where S[n] is the same window shaping function used in the watermark conditioning circuit 
of Fig. 5. A person skilled in the art will appreciate that equation 1 1 represents a matched 
20 filter receiver, and is the optimum receiver when the sjmibol period is perfectly synchronized. 
Not withstanding this fact, from now on, we SQtS[n]=l in order to simplify subsequent 
explanations. 



For simplification, it is assumed that there is perfect synchronism between the 



The energy corresponding to the y'b,m[nj frame is: 




(11) 



Combining this with equation 10, it follows that: 




(12) 



25 



where WefmJ is the m-th extracted watermark symbol, and contains Nb time-multiplexed 
estimates of the embedded watermark sequences. Solving for WefmJ in equation 12 and 
ignoring higher order terms of a, gives the following approximation: 
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2a 



ZT,-\\ r ,|2 



(13) 



In the watermark extraction stage 200 shown in Fig. 8, the output y'b[n] of the 
filter Hb is provided as an input to a frame divider 220, which divides the audio signal into 
frames of length Ts i.e. into y'b,m[n], with the energy calculating unit 230 then being used to 
calculate the energy corresponding to each of the framed signals as per equation (11). The 
output of this energy calculation unit 230 is then provided as an input to the whitening stage 

(240) which performs the function shown in equation 13 so as to provide an output 
Wefm].], Altemative implementations (240 A, 240B) of this whitening stage are illustrated in 
Figs. 9 and 10. 

It will be realized that the denominator of equation 13 contains a term that 
requires knowledge of the host (original) signal x. As the signal x is not available to the 
detector, it means that in order to calculate We[m] then the denominator of equation 13 must 

be estimated. 

Below is described how such an estimation can be achieved for the two 
described window shaping functions (the raised cosine window shaping function and the bi- 
phase window shaping function), but it will equally be appreciated that the teaching could be 
extended to other window shaping functions. 

In relation to the raised cosine window shaping function shown in Fig. 6a, it 
has been realized that the audio envelope induced by the watermark contributes 
predominantly to the noisy part of the energy function E[m], The slowly varying part (i.e. the 
low frequency components) is predominately due to the contribution of the envelope of the 
original audio signal x. Thus, equation 13 may be approximated by: 



wApi]^ — 
2a I 



E{m\ 
lowpass(£[m]) 



-1 



(14) 
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where "lowpass (.)" is a low pass filter function. Thus, it will be appreciated that the 
whitening filter Hy^ for the raised cosine window shape in the function can be realized as 
shown in Fig. 9. 

As can be seen, such a whitening filter (240A) comprises an input 242A 
5 for receiving the signal E[m] . A portion of this signal is then passed through the low pass 
filter 247 A to produce a low pass filtered energy signal ELpfmJ, which in turn is provided as 
an input to the calculation stage 248A along with the function E[m] . The calculation stage 
248A then divides E[m] by ELp[m] to calculate the extracted watermark symbol We[m] . 

When a bi-phase window function is employed in the watermark conditioning 
10 stage of the embedder, a different approach should be utilized to estimate the envelope of the 
original audio, and hence to calculate We[m] . 

It will be seen by examination of the bi-phase window function shown in Fig. 
6b, that when the envelope of an audio frame is modulated with such a window function, the 
first and the second halves of the frame are scaled in opposite directions. In the detector, this 
15 property is utilized to estimate the envelope energy of the host signal x. 

Consequently, within the detector, the audio frame is first sub-divided into two 
halves. The energy functions corresponding to the first and second halve frames are hence 
given by 

T /2-1 

Z V'bA^t (15) 

and 

E2[m]= Y.\yb,m[^f (16) 

n=TJ2 

20 

respectively. As the envelope of the original audio is modulated in opposite directions within 
the two sub-frames, the original audio envelope can be approximated as the mean of EjfmJ 
3ndE2fmJ. 

Further, the instantaneous modulation value can be taken as the difference 
25 between these two functions. Thus, for the bi-phase window function, the watermark WefmJ 
can be approximated by: 
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if Ei[m]-E2[m] 

We[w]« — — — - 

2a \^Ei[m] + E2[m] 



-1 
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(17) 



Consequently, the whitening filter H^; 240B for a bi-phase window shaping 
function can be realized as shown in Fig. 10. Inputs 242B and 243B respectively receive the 
energy functions of the first and second halve frames Ei[m] and E2[m]. Each energy function 
5 is then split up into two, and provided to adders 245B and 246B which respectively calculate 
Ei[m] - E2[m]^ and Ei[m] + E2[m]. Both of these calculated functions are then passed to the 
calculating unit 248B which divides the value from adder 245B by the value from 246B so as 
to calculate the watermark We[m]^ in accordance with equation 17. 

This output We[ni] is then passed to the buffering and interpolation stage 300, 

10 where the signal is de-multiplexed by a de-multiplexer 310, buffered in buffers 320 of length 
Lb so as to resolve any lack of synchronism between the embedder and the detector and 
interpolated within the interpolation unit 330 so as to compensate for any time scale 
modification between the embedder and the detector. Such compensation can utilize known 
techniques, and hence is not described in any more detail within this specification. 

15 As shown in Fig. 8, outputs (woh y^D2, ••• y^om) from the buffering stage are 

passed to the interpolation stage and, after interpolation, the outputs (wn, wn, ... wim) of this 
stage, which correspond to the different estimates of the correctly re-scaled signal, are passed 
to the correlation and decision stage. If it is believed that no time scaling compensation is 
required, the values (wdl y^ni, ... y^nm) can be passed directly to the correlation and decision 

20 stage 400 i.e. the interpolation stage 330 can be omitted from the apparatus. 

The correlator 410 calculates the correlation of each estimate wipj=l, ...,Nb 
with respect to the reference watermark sequence Ws[k] . Each respective correlation output 
corresponding to each estimate is then applied to the maximum detection unit 420 which 
determines which two estimates provided the best fits for the circularly shifted versions Wdi 

25 and Wd2 of the reference watermark. The correlation values (the peak amplitudes and 

positions) for these estimate sequences are passed to the threshold detector and payload 
extractor unit 430. 

If the interpolation stage is omitted, altematively the correlator 410 calculates 
the correlation of each estimate WDpj=L •••,Nb with the reference watermark sequence WsfkJ 
30 and the results are passed on for subsequent processing to the units 420 and 430 as outlined 
in the above paragraph. 
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The threshold detector and payload extractor unit 430 may be utilized to 

extract the payload (e.g. information content) from the detected watermark signal. Once the 

unit has estimated the two correlation peaks cLi and CL2 that exceed the detection threshold, 

the distance pL between the peaks (as defined by equation (6)) is measured. Next, the signs 
5 pi and p2 of the correlation peaks are determined, and hence rsign calculated from equation 

(7). The overall watermark payload may then be calculated using equation (8). 

For instance, it can be seen in Fig. 1 1 that pL is the relative distance between 

the two peaks. Both peaks are positive i.e. = +1, and p2 = ^\. From equation (7), rsign = 3. 

Consequently, the payload pLw = <3, pL>. 
10 The reference watermark sequence Ws used within the detector corresponds to 

(a possibly circularly shifted version of) the original watermark sequence applied to the host 

signal. For instance, if the watermark signal was calculated using a random number generator 

with seed S within the embedder, then equally the detector can calculate the same random 

number sequence using the same random number generation algorithm and the same initial 
15 seed so as to determine the watermark signal. Altematively, the watermark signal originally 

applied in the embedder and utilized by the detector as a reference could simply be any 

predetermined sequence. 

Fig. 1 1 shows a typical shape of a correlation function as output from the 

correlator 410. The horizontal scale shows the correlation delay (in terms of the sequence 
20 bins). The vertical scale on the left hand side (referred to as the confidence level cL) 

represents the value of the correlation peak normalized with respect to the standard deviation 

of the (typically normally distributed) correlation fiinction. 

As can be seen, the typical correlation is relatively flat with respect to cL, and 

centered about cL = 0. However, the fiinction contains two peaks, which are separated by pL 
25 (see equation 6) and extend upwards to cL values that are above the detection threshold when 

a watermark is present. When the correlation peaks are negative, the above statement applies 

to their absolute values. 

A horizontal line (shown in the Fig. as being set at cL = 8.7) represents the 

detection threshold. The detection threshold value controls the false alarm rate. 
30 Two kinds of false alarms exist: the false positive rate, defined as the 

probability of detecting a watermark in non watermarked items, and the false negative rate, 

which is defined as the probability of not detecting a watermark in watermarked items. 

Generally, the requirement of the false positive alarm is more stringent than that of the false 

negative. The right hand side scale on Fig. 1 1 illustrates the probability of a false positive 
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alarm p. As can be seen, in the example shown, the probability of a false positive p=10~^^ is 
equivalent to the threshold cL = 8.7, whilst p = 10'^^ is equivalent to cL = 20. 

After each detection interval, the detector determines whether the original 
watermark is present or whether it is not present, and on this basis output a "yes" or a "no" 
decision. If desired, to improve this decision making process, a number of detection windows 
may be considered. In such an instance, the false positive probability is a combination of the 
individual probabilities for each detection window considered, dependent upon the desired 
criteria. For instance, it could be determined that if the correlation function has two peaks 
above a threshold of cL = 7 on any two out of three detection intervals, then the watermark is 
deemed to be present. Obviously, such detection criteria can be altered depending upon the 
desired use of the watermark signal and to take into account factors such as the original 
quality of the host signal and how badly the signal is likely to be corrupted during normal 
transmission. 

It will be appreciated by the skilled person that various implementations not 
specifically described would be understood as falling within the scope of the present 
invention. For instance, whilst only the functionality of the embedding and detecting 
apparatus has been described, it will be appreciated that the apparatus could be realized as a 
digital circuit, an analog circuit, a computer program, or a combination thereof. 

Equally, whilst the above embodiment has been described with reference to an 
audio signal, it will be appreciated that the present invention can be applied to other types of 
signal, for instance video and data signals. 

Within the specification it will be appreciated that the word "comprising" does 
not exclude other elements or steps, that "a" or "and" does exclude a plurality, and that a 
single processor or other unit may fulfil the fimctions of several means re-cited in the claims. 



